Narration of network content

ABSTRACT

A process is directed to the generation, maintenance, and provision of narrations for requested network content. A client computing device transmits a narration of a network resource, such as a web page, to a network computing provider. The narration can be separated into portions, each portion corresponding to a portion of the network resource. A second client computing device can request the network resource and the narration. The network computing provider can determine whether there has been any change in the requested network resource since the narration was received, and can modify the narration provided to the second client computing device accordingly. The second client computing device can playback appropriate portions of the narration while still being capable of regular interaction with the requested network resource.

CROSS-REFERENCE TO RELATED APPLICATION

This application is a continuation of U.S. patent application Ser. No.13/359,028, entitled NARRATION OF NETWORK CONTENT and filed Jan. 26,2012, now U.S. Pat. No. 9,087,024, the entirety of which is incorporatedby reference herein.

BACKGROUND

Generally described, computing devices and communication networks can beutilized to exchange information. In a common application, a computingdevice can request content from another computing device via thecommunication network. For example, a user at a personal computingdevice can utilize a software browser application, typically referred toas a browser software application, to request a Web page from a servercomputing device via the Internet. In such embodiments, the usercomputing device can be referred to as a client computing device and theserver computing device can be referred to as a content provider.

With reference to an illustrative example, a requested Web page, ororiginal content, may be associated with a number of additionalresources, such as images or videos, that are to be displayed with theWeb page. In one specific embodiment, the additional resources of theWeb page are identified by a number of embedded resource identifiers,such as uniform resource locators (“URLs”). In turn, software on theclient computing devices, such as a browser software application,typically processes embedded resource identifiers to generate requestsfor the content. Accordingly, in order to satisfy a content request, oneor more content providers will generally provide client computingdevices data associated with the Web page as well as the data associatedwith the embedded resources.

Once the client computing device obtains the Web page and associatedadditional resources, the content may be processed in a number of stagesby the software browser application or other client computing deviceinterface. For example, and with reference to the above illustration,the software browser application may parse the Web page to processvarious HTML layout information and references to associated resources,may identify and process Cascading Style Sheets (“CSS”) information, mayprocess and instantiate various Javascript code associated with the Webpage, may construct a native object model to represent one or morecomponents of the Web page, and may calculate various layout and displayproperties of the processed content for presentation to a user.

Generally described, Web pages are primarily visual, consisting oftextual elements, images, videos, animation, etc. Accordingly, userswith visual impairments, an inability to read, or limited visualdisplays may not be able to consume and interact with the visual contenton the page. In similar manner, Web pages contain aural elements, suchas music, sound effects, etc. Such aural elements may be difficult toconsume and interact with by users with hearing impairments or limitedsound resources or restrictions on the use of sound resources.

BRIEF DESCRIPTION OF THE DRAWINGS

The foregoing aspects and many of the attendant advantages of thisinvention will become more readily appreciated as the same become betterunderstood by reference to the following detailed description, whentaken in conjunction with the accompanying drawings, wherein:

FIG. 1 is a block diagram illustrative of a content delivery environmentincluding a number of client computing devices, content provider, acontent delivery network service provider, and a network computingprovider;

FIG. 2 is a block diagram of the content delivery environment of FIG. 1illustrating the generation and processing of a new browse sessionrequest from a client computing device to a network computing provider;

FIG. 3 is a block diagram of the content delivery environment of FIG. 1illustrating the generation and processing of a request for a networkresource from a network computing provider to a content provider;

FIG. 4 is a block diagram of the content delivery environment of FIG. 1illustrating the generation and processing of one or more requestscorresponding to one or more embedded resources from a network computingprovider to a content provider and content delivery network;

FIG. 5 is a block diagram of the content delivery environment of FIG. 1illustrating the generation and processing of browse session data anduser interaction data between a network computing provider and clientcomputing device;

FIG. 6 is a block diagram of the content delivery environment of FIG. 1illustrating the generation and processing of an additional new browsesession request from a client computing device to a network computingprovider;

FIG. 7A is a user interface diagram depicting an illustrative browserinterface and display of browse session content and narration features;

FIG. 7B is a user interface diagram depicting an illustrative browserinterface and display of browse session content and playback features;

FIG. 7C is a user interface diagram depicting an illustrative browserinterface and display of browse session content and alternative playbackfeatures;

FIG. 8 is a diagram depicting illustrative browser content processingactions as a series of processing subsystems;

FIG. 9 is a flow diagram illustrative of a new browse session routineimplemented by network computing provider;

FIG. 10 is a flow diagram illustrative of a client new browse sessioninteraction routine implemented by a client computing device;

FIG. 11 is a flow diagram illustrative of a process user interactionroutine implemented by a client computing device;

FIG. 12 is a flow diagram illustrative of a routine implemented by anetwork computing provider for receiving and processing narration of anetwork resource;

FIG. 13 is a flow diagram illustrative of a routine implemented by anetwork computing provider for processing and responding to a requestfor playback of a narration; and

FIG. 14 is a flow diagram illustrative of a routine implemented by anetwork computing provider for processing changes to a narration of anetwork resource.

DETAILED DESCRIPTION

Generally described, the present disclosure is directed to the renderingof network resources as requested by a client computing device.Specifically, aspects of the disclosure will be described with regard tothe creation, modification, and playback of aural or visual narrationsof content associated with network resources, such as web pages. Forexample, a narration may be a spoken or computer-generated auralrecitation of the textual elements of the content, an aural descriptionof visual elements of the content, a textual transcription of any auralelements in the content, visual effects highlighting various portions ofthe content, commentary about the content or related topics, etc.Additionally, other aspects of the present disclosure relate to thestorage and maintenance of narration information. Still further, aspectsof the present disclosure relate to modification of the narrations inresponse to changes in the corresponding network resources. In stillanother aspect of the present disclosure, client computing devices canbe provisioned with narration information. Although aspects of theembodiments described in the disclosure will focus, for the purpose ofillustration, on the processing by a network computing provider, oneskilled in the art will appreciate that the techniques disclosed hereinmay be applied to any number of hardware or software processes orapplications. Further, although various aspects of the disclosure willbe described with regard to illustrative examples and embodiments, oneskilled in the art will appreciate that the disclosed embodiments andexamples should not be construed as limiting.

With reference to an illustrative example, a user may cause a clientcomputing device to load a software browser application (henceforthreferred to as a “browser”) for accessing content provided by one ormore content providers. Illustratively, the accessed content may includea collection of one or more network resources (e.g., a Web page) andembedded resources, such as images, video, audio, text, executable code,and other resources. In one embodiment, the browser may have a contentdisplay area or pane for displaying the accessed network content inaddition to one or more local interface components, such as toolbars,menus, buttons, or other user interface controls. Local interfacecomponents may be managed and controlled by the software browserapplication or any other process executing or implemented locally at theclient computing device. Illustratively, managing user interfacecontrols locally may allow for a responsive user interface, asinteractions by the user are processed locally on the client computingdevice.

Subsequent to the browser being loaded, a user or automated browserprocess may cause the client computing device to transmit a request toaccess content from a content provider. For example, the user may selector enter a URL, (e.g., http://www.xyzwebsite.com) into a browser window,causing the client computing device to transmit a request for contentcorresponding to the URL. In an illustrative embodiment, the request canbe transmitted to a network computing provider. Responsive to therequest received from the client computing device, the network computingprovider may instantiate or cause to have instantiated one or morecomputing components associated with the network computing provider thatwill host a browser software application. For example, the networkcomputing provider can instantiate, or cause to have instantiated, aninstance of a virtual machine that includes a software browserapplication capable of requesting resources from a communicationnetwork. Illustratively, in some situations, one or more devicesassociated with the network computing provider may be located in a datacenter or other robustly networked computing environment, and, ascompared to the client computing device, may experience relativelylittle latency or delay when obtaining network resources.

Using the instantiated network computing components, the networkcomputing provider may request the identified network resource(s) fromone or more content provider s, a content delivery network, or a localor associated cache component. For example, the browser softwareapplication on the instantiated network computing component can processa primary network resource and then generate additional content requestsfor content identified in one or more embedded resource identifiers(e.g. pictures, video files, etc.). Illustratively, in the case ofother, non-browser, applications, network resources, or content mayinclude any file type or format known in the art and supported by thespecific software application.

Having obtained the requested content (e.g., the requested networkresource and embedded resources), the network computing provider mayidentify one or more browsing configurations for the requested content,based on the processing requirements for one or more portions of therequested content. In addition, the network computing provider maydetermine that a narration of the requested content is available. Thenarration may have been received by the network computing provider at aprevious time from a separate user of a client computing device. Thenarration may be a spoken recitation of the textual elements of thecontent, a spoken description of visual elements of the content, atextual transcription of any sound in the content, visual effectshighlighting various portions of the content, etc. The network computingprovider may provide access to the narration in addition to performingother processing of the network resource according to the browsingconfiguration.

In an illustrative embodiment, the network computing provider cananalyze the requested content and compare the results to the requestednetwork resource as it existed when the narration was created. Thenetwork computing provider can modify the narration if it determinesthat the requested content has changed since the narration was created.For example, the network computing provider can remove narration ofcontent that no longer exists as part of the network resource, insert awarning to the user that the narration may not be accurate, etc. Thenetwork computing provider can provide the narration to the user of theclient computing device all at once, as in streaming content with audio,in response to the selection of certain portions of the requestedcontent at the client computing device, etc. The network computingprovider can also cause elements to be displayed with the requestedcontent to indicate to the user that a narration is available. The userof the client computing device can continue to interact with the networkresource in a manner similar or identical to the manner of interactionif there were no narration.

FIG. 1 is a block diagram illustrative of a networked computingenvironment 100 for the management and processing of content requests.As illustrated in FIG. 1, the networked computing environment 100includes a number of client computing devices 102 (generally referred toas clients) for requesting content and content processing from a contentprovider 104, CDN service provider 106, or network computing provider107. In an illustrative embodiment, the client computing devices 102 cancorresponds to a wide variety of computing devices including personalcomputing devices, laptop computing devices, hand-held computingdevices, terminal computing devices, mobile devices (e.g., mobilephones, tablet computing devices, etc.), wireless devices, variouselectronic devices and appliances and the like. In an illustrativeembodiment, the client computing devices 102 include necessary hardwareand software components for establishing communications over acommunication network 108, such as a wide area network or local areanetwork. For example, the client computing devices 102 may be equippedwith networking equipment and browser software applications thatfacilitate communications via the Internet or an intranet. The clientcomputing devices 102 may have varied local computing resources, such ascentral processing units and architectures, memory, mass storage,graphics processing units, communication network availability andbandwidth, etc.

The networked computing environment 100 can also include a contentprovider 104 in communication with the one or more client computingdevices 102 or other service providers (e.g., CDN service provider 106,network computing provider 107, etc.) via the communication network 108.The content provider 104 illustrated in FIG. 1 corresponds to a logicalassociation of one or more computing devices associated with a contentprovider. Specifically, the content provider 104 can include a webserver component 110 corresponding to one or more server computingdevices for obtaining and processing requests for content (such as Webpages) from the client computing devices 102 or other service providers.The content provider 104 can further include an origin server component112 and associated storage component 114 corresponding to one or morecomputing devices for obtaining and processing requests for networkresources from the CDN service provider. The content provider 104 canstill further include an application server computing device 111, suchas a data streaming server, for processing streaming content requests.One skilled in the relevant art will appreciate that the contentprovider 104 can be associated with various additional computingresources, such as additional computing devices for administration ofcontent and resources, DNS name servers, and the like. For example,although not illustrated in FIG. 1, the content provider 104 can beassociated with one or more DNS name server components that would beauthoritative to resolve client computing device DNS queriescorresponding to a domain of the content provider.

With continued reference to FIG. 1, the networked computing environment100 can further include a CDN service provider 106 in communication withthe one or more client computing devices 102 and other service providersvia the communication network 108. The CDN service provider 106illustrated in FIG. 1 corresponds to a logical association of one ormore computing devices associated with a CDN service provider.Specifically, the CDN service provider 106 can include a number of Pointof Presence (“POP”) locations 116, 122, 128 that correspond to nodes onthe communication network 108. Each CDN POP 116, 122, 128 includes a DNScomponent 118, 124, 130 made up of a number of DNS server computingdevices for resolving DNS queries from the client computers 102. EachCDN POP 116, 122, 128 also includes a resource cache component 120, 126,132 made up of a number of cache server computing devices for storingresources from content providers and transmitting various requestedresources to various client computers. The DNS components 118, 124, and130 and the resource cache components 120, 126, 132 may further includeadditional software and/or hardware components that facilitatecommunications including, but not limited to, load balancing or loadsharing software/hardware components.

In an illustrative embodiment, the DNS component 118, 124, 130 andresource cache component 120, 126, 132 are considered to be logicallygrouped, regardless of whether the components, or portions of thecomponents, are physically separate. Additionally, although the CDN POPs116, 122, 128 are illustrated in FIG. 1 as logically associated with theCDN service provider 106, the CDN POPs will be geographicallydistributed throughout the communication network 108 in a manner to bestserve various demographics of client computing devices 102.Additionally, one skilled in the relevant art will appreciate that theCDN service provider 106 can be associated with various additionalcomputing resources, such as additional computing devices foradministration of content and resources, and the like.

With further continued reference to FIG. 1, the networked computingenvironment 100 can also include a network computing provider 107 incommunication with the one or more client computing devices 102, the CDNservice provider 106, and the content provider 104 via the communicationnetwork 108. The network computing provider 107 illustrated in FIG. 1also corresponds to a logical association of one or more computingdevices associated with a network computing provider. Specifically, thenetwork computing provider 107 can include a number of Point of Presence(“POP”) locations 134, 142, 148 that correspond to nodes on thecommunication network 108. Each POP 134, 142, 148 includes a networkcomputing component (NCC) 136, 144, 150 for hosting applications, suchas data streaming applications, via a number of instances of a virtualmachine, generally referred to as an instance of an NCC. One skilled inthe relevant art will appreciate that NCC 136, 144, 150 would includephysical computing device resources and software to provide the multipleinstances of a virtual machine or to dynamically cause the creation ofinstances of a virtual machine. Such creation can be based on a specificrequest, such as from a client computing device, or the NCC can initiatedynamic creation of an instance of a virtual machine on its own. EachNCC POP 134, 142, 148 also includes a storage component 140, 146, 152made up of a number of storage devices for storing any type of data usedin the delivery and processing of network or computing resources,including but not limited to user data, state information, processingrequirements, historical usage data, and resources from contentproviders that will be processed by an instance of an NCC 136, 144, 150and transmitted to various client computers, etc. The NCCs 136, 144, 150and the storage components 140, 146, 152 may further include additionalsoftware and/or hardware components that facilitate communicationsincluding, but not limited to, load balancing or load sharingsoftware/hardware components for selecting instances of a virtualmachine supporting a requested application and/or providing informationto a DNS nameserver to facilitate request routing.

In an illustrative embodiment, NCCs 136, 144, 150 and the storagecomponents 140, 146, 152 are considered to be logically grouped,regardless of whether the components, or portions of the components, arephysically separate. For example, a network computing provider 107 maymaintain separate POPs for providing the NCC and the storage components.Additionally, although the NCC POPs 134, 142, 148 are illustrated inFIG. 1 as logically associated with a network computing provider 107,the NCC POPs will be geographically distributed throughout thecommunication network 108 in a manner to best serve various demographicsof client computing devices 102. Additionally, one skilled in therelevant art will appreciate that the network computing provider 107 canbe associated with various additional computing resources, suchadditional computing devices for administration of content andresources, and the like. Even further, one skilled in the relevant artwill appreciate that the components of the network computing provider107 and components of the CDN service provider 106 can be managed by thesame or different entities.

With reference now to FIGS. 2-6, the interaction between variouscomponents of the networked computing environment 100 of FIG. 1 will beillustrated. Specifically, FIGS. 2-6 illustrate the interaction betweenvarious components of the networked computing environment 100 for theexchange of content between a client computing device 102 and a contentprovider 104 via the network computing provider 107. For purposes of theexample, the illustrations have been simplified such that many of thecomponents utilized to facilitate communications are not shown. Oneskilled in the relevant art will appreciate that such components can beutilized and that additional interactions would accordingly occurwithout departing from the spirit and scope of the present disclosure.

With reference to FIG. 2, the process can begin with the generation andprocessing of a browse session request from a client computing device102 to a network computing provider 107 will be described.Illustratively, the client computing device 102 may load a browser forviewing network content in response to an event or user request.Subsequent to the browser being loaded, the browser may be implementedto request a new browse session. From the perspective of the user of theclient computing device, the request for the new browse sessioncorresponds to the intended request to transmit the request to one ormore corresponding content providers 104. Illustratively, this requestmay be generated automatically as a result of the browser loading (e.g.,a request for a default or “home” page), or may be generated as a resultof a user following a link or entering a network address into an addressbar. As illustrated in FIG. 2, the browse session request is transmittedfirst to a network computing provider 107. In an illustrativeembodiment, the network computing provider 107 utilizes a registrationapplication program interface (“API”) to accept browse session requestsfrom the client computing device 102. The browse session request caninclude network address information corresponding to a requested networkresource, which may be in any form, including, but not limited to, anInternet Protocol (“IP”) address, a URL, a Media Access Control (“MAC”)address, etc.

Subsequent to the receipt of the browse session request, the networkcomputing provider 107 may select an associated network computingcomponent (hereinafter “NCC”) point of presence (hereinafter “POP”) suchas NCC POP 142 to service the browse session request. The selection ofthe NCC POP may determine the processing and network resources availableto the instantiated virtual machine. The selection of processing andnetwork resources and the provisioning of software at the NCC POPinstance may be done, at least in part, in order to optimizecommunication with content providers 104 and client computing devices102. As illustrated in FIG. 2, the identification data received with thebrowse session request can be passed to the NCC POP instance servicingthe browse session request.

With reference to FIG. 3, an illustrative interaction for generation andprocessing of a request for a network resource from a network computingprovider 107 to a content provider 104 will be described. As illustratedin FIG. 3, the selected NCC POP 142 may generate a browse sessioncorresponding to one or more content providers based on a browse sessionrequest, such as the illustrative browse session request depicted inFIG. 2 above. Illustratively, instantiating a new browse sessioninstance may include loading a new virtual machine instance and/orbrowser instance at the NCC POP 142, reserving or allocating devicememory, storage or cache space, processor time, network bandwidth, orother computational or network resources for the new browse session.

Subsequent to initializing a new browse session instance, NCC POP 142may provide a request for a network resource to a content provider 104based on a network address included in the browse session request. Forexample, a browse session request may include a URL for a Web page, suchas “http://www.xyzsite.com/default.htm.” NCC POP 142 may resolve the URLto an IP address through a DNS resolver associated with the networkcomputing provider (not shown), and may request the Web page from thecontent provider 104 at the resolved IP address. In various embodiments,a network resource may be retrieved from any combination of contentproviders, content delivery network (hereinafter “CDN”) servers, orcaches associated with the network computing provider 107. For example,the network computing provider may check if a resource is stored in alocal cache or in another server or service provider associated with thenetwork computing provider 107. If a network resource is stored in alocal or associated location, the NCC POP 142 may retrieve the networkresource from the local or associated location rather than from thethird party content provider 104 or CDN service provider 106.Illustratively, the NCC POP 142 may provide requests for any number ofnetwork resources as included in the browse session request, and mayobtain these network resources from any number of different sources,sequentially or in parallel.

As illustrated in FIG. 3, the content provider 104 receives the resourcerequest from the NCC POP 142 and processes the request accordingly. Inone embodiment, the content provider 104 processes the resource requestas if it were originally provided by the client computing device 102.For example, the content provider 104 may select the type of content,ordering of content, or version of content according to the requirementsof the requesting client computing device 102. In another embodiment,the content provider 104 may be provided with information that providesinformation associated with the NCC POP 142 for utilization in providingthe requested content (e.g., an available amount of processing resourcesor network bandwidth).

Subsequent to obtaining the requested network resource from the contentprovider 104 (or other source designated by the content provider), theNCC POP 142 may process the network resource to extract embeddedresource identifiers and gather information for determination of aremote session browsing configuration. For example, a network resourcesuch as a Web page may include embedded CSS style information andJavascript as well as embedded resource identifiers to additionalresources, such as text, images, video, audio, animation, executablecode, and other HTML, CSS, and Javascript files. In the process ofextracting the embedded resource identifiers, the NCC POP 142 may gatherinformation about the processed network resources for later use in thedetermination of a remote session browsing configuration as discussedbelow with reference to FIG. 4.

With reference to FIG. 4, an illustrative interaction for generation andprocessing of one or more requests corresponding to one or more embeddedresources from a network computing provider to a content provider andcontent delivery network is disclosed. As illustrated in FIG. 4, theselected NCC POP 142 may provide resource requests to one or moresources of content such as content provider 104 and CDN POP 116. Theresource requests may correspond to embedded resources based on one ormore embedded resource identifiers extracted from a requested networkresource (e.g., a Web page) as described in FIG. 3 above. In variousembodiments, embedded resources may be retrieved from any combination ofcontent providers, CDN servers, or caches associated with the networkcomputing provider 107. For example, the network computing provider maycheck if an embedded resource is stored in a local cache or in anotherserver or service provider associated with the network computingprovider 107. If an embedded resource is stored in a local or associatedlocation, the NCC POP 142 may retrieve the embedded resource from thelocal or associated location rather than the third party contentprovider or CDN. Illustratively, the NCC POP 142 may provide requestsfor any number of embedded resources referenced by a network resource,and may obtain these embedded resources from any number of differentsources, sequentially or in parallel. Subsequent to obtaining therequested resources, the NCC POP 142 may process the resources andrequested content to determine a remote session browsing configurationfor the processing and communication of content to the client computingdevice 102.

With reference to FIG. 5, an illustrative interaction for generation andprocessing of processing results and user interaction data between anetwork computing provider and client computing device is disclosed. Aspreviously described, in one embodiment, the respective browsers on theinstantiated network computing component and the client computing device102 can exchange browsers' session information related to the allocationand processing of the requested resources at the instantiated networkcomputing component and client computing device. As illustrated in FIG.5, the selected NCC POP 142 may provide an initial processing result tothe client computing device 102 over the network 108. The initialprocessing result may correspond to requested network content, such as aWeb page, along with associated embedded resources processed by the NCCPOP 142 in accordance with a selected remote session browsingconfiguration as described in FIG. 4 above. The NCC POP 142 also makes adetermination of which additional processes will be conducted at the NCCPOP 142, at the client computing device 102, or both, as illustrated inFIG. 5. Subsequent to receiving an initial processing result and theallocation of processes, the client computing device 102 may perform anyremaining processing actions on the initial processing result asrequired by the selected remote session browsing configuration, and maydisplay the fully processed content in a content display area of abrowser. The client computing device 102 may process any local userinteractions with local interface components or content elementslocally, and may provide user interactions requiring remote processingto the network computing provider 107. The network computing provider107 may provide updated processing results to the client computingdevice 102 in response to changes to the content or remote userinteraction data from the client computing device 102.

With reference to FIG. 6, a block diagram of the content deliveryenvironment of FIG. 1 illustrating the generation and processing of anadditional new browse session request from a client computing device toa network computing provider is disclosed. As illustrated in FIG. 6, asecond new browse session request may be sent to network computingprovider 107 from client computing device 102 across network 108. In anillustrative embodiment, the network computing provider 107 utilizes aregistration API to accept browse session requests from the clientcomputing device 102.

The additional browse session request may be generated by a clientcomputing device 102 in response to a user opening up a new browserwindow with a new content display area, opening a new content displayarea in an existing browser window (e.g., opening a new tab in abrowser), requesting new network content in an existing content displayarea (e.g., following a link to a new network resource, or entering anew network address into the browser), or any other user interaction.For example, a user browsing a first Web page corresponding to a firstbrowse session instance may follow a link that opens a new tab orbrowser window to view a second Web page. In one embodiment, anyrequired steps of obtaining and processing content associated with thesecond Web page may be performed by the currently instantiated networkcomputing component in which the browser can handle the processing ofboth resource requests. In another embodiment, the client computingdevice 102 request may be processed as a new browse session request tothe network computing provider 107, including the network address of thesecond Web page. In this embodiment, the browser on the client computingdevice may not specifically request a separate browse session, and auser's interaction with the browser on the client computing device 102may appear to be part of a same browsing session. As described abovewith regard to FIGS. 2 and 3, the network computing provider 107 maycause an instantiation of a network computing component for obtainingand processing content associated with the second web page. In otherembodiments, a new browse session request may be generated by the clientcomputing device 102 corresponding to sections of a network resource(e.g., frames of a Web page), individual network resources, or embeddedresources themselves, data objects included in a set of content, orindividual network resources.

Illustratively, the additional browse session request may include anynumber of pieces of data or information including, but not limited to,information associated with a user, information associated with theclient computing device 102 (e.g., hardware or software information, adevice physical or logical location, etc.), information associated withthe network 108, user or browser preferences (e.g., a requested remotesession browse protocol, a preference list, a decision tree, or otherinformation), information associated with the network computing provider107, information associated with one or more pieces of requested networkcontent (e.g., the network address of a network resource), etc.Requested content may include any manner of digital content, includingWeb pages or other documents, text, images, video, audio, executablescripts or code, or any other type of digital resource.

As illustrated in FIG. 6, subsequent to the receipt of the browsesession request the network computing provider 107 may select anassociated network computing component such as NCC POP 142 to servicethe browse session request. As discussed above with reference to FIG. 2,a network computing provider 107 may select an NCC POP to service abrowse session request based on any number of factors, including, butnot limited to available NCC POP resources (e.g., available memory,processor load, network load, etc), a financial cost of servicing thebrowse session request at the NCC POP, the NCC POP location respectiveto a client computing device 102, content provider 112, or CDN POP 116,a NCC POP cache status (e.g., whether a requested resource is alreadystored in an NCC POP cache), etc. In one embodiment, the networkcomputing provider 107 may select a number of NCC POPs to service abrowse session request. Illustratively, although the network computingprovider 107 is depicted here for purposes of illustration as selectingNCC POP 142, the network computing provider 107 may select any extantNCC POP to service the browse session request. For example, a singleclient computing device 102 may simultaneously or sequentially providethree different browse session requests to the network computingprovider 107 corresponding to different network resources. The networkcomputing provider 107 may select different NCC POPs for each browsesession request, the same NCC POP for all three browse session requests,or any combination thereof. As discussed above, the decision whether toselect a different NCC POP than was utilized for a previous orsimultaneous browse session request may be made on the basis ofavailable system resources, randomly, or according to any other factoras discussed above and with regards to FIG. 2.

FIG. 7A is a user interface diagram depicting an illustrative browserinterface and display of browse session content. As described above withreference to FIG. 5, a browser 700 may have a content display area 702,as well as one or more one or more local interface components. Theselocal interface components may include toolbars, menus, buttons, addressbars, scroll bars, window resize controls, or any other user interfacecontrols. For example, the local interface components can include atoolbar with a narrate button 704 to facilitate the creation ofnarrations for content displayed in the content display area 702.Illustratively, local interface components may be displayed as separatefrom the content display area 702 or may be overlaid or embedded in thecontent display area 702.

Interactions with local interface components may be treated as localuser interactions or remote user interactions depending on theprocessing required by the interaction and the remote session browsingconfiguration. For example, the selection of a preferences option in abrowser menu may be handled entirely as a local user interaction by abrowser. The processing required to display the menu, provide visualfeedback regarding the selection, display the preferences window, andprocess the changes made to the browser preferences may be performedlocally. As discussed above, processing user interactions locally mayprovide greater responsiveness at the browser as opposed to sending userinteraction data to the NCC POP 142 for processing. As another example,when using a remote session browsing configuration that specifiesextensive processing on the NCC POP 142 (e.g., a remote session browsingconfiguration using a remote session communication protocol such asRDP), the selection of a content refresh button in a browser toolbar maybe handled both as a local user interaction and a remote userinteraction. The limited processing required to provide interfacefeedback corresponding to the button selection may be handled at theclient computing device 102 in order to provide the appearance ofinterface responsiveness, while the refresh command, which may requireprocessing of the network content displayed in the content display areaof the browser, may be sent as user interaction data to the NCC POP 142for processing. The NCC POP 142 may then transmit updated processingresults corresponding to the refreshed network content back to theclient computing device 102 for display.

In response to a user selecting the narration button 704, the browsermay enter a narration creation mode. During the narration creation mode,the user may verbally describe the content visible on the screen.Additionally, the user can select content that will be automaticallynarrated, such as by an automated text to speech software application.In some embodiments, the narration may include visual components, suchas text and animation, in addition to or instead of a verbaldescription. While in narration creation mode, the normal cursor may bealtered such that the user has visual feedback that the browser is innarration creation mode. For example, after selecting the narrationbutton 704 to enter narration creation mode, the cursor may be changedto the cursor 706 illustrated in FIG. 7A.

The user may describe an image, such as image 710. In one embodiment,the user can manipulate the cursor 706 to select a portion 708 of thepage to describe. In FIG. 7A, the portion 708 contains the image 710that the user will describe. The user can select other portions of thepage and describe the visible contents of the other potions, in somecases reading the text on the screen, highlighting portions of text withthe cursor, etc. In the case of a web page with hyperlinks and otherinteractive controls, the user can select a hyperlink and describe thedestination referenced by the selected the hyperlink. In similarfashion, other interactive controls such as command buttons, radiobuttons, and drop-down lists can be activated and described for thenarration. The motion of the cursor on the screen can be recorded forplayback, allowing the narrator to point to various elements whenspeaking about them. Various cursor, keyboard, menu, or spoken inputscan also be recorded to display visual effects during playback, such ashighlighting, etc. When the user has finished creating the narration,the user can again select the narration button 704 to stop narrationcreation and submit the narration to the network computing provider 107.In some embodiments, the functions of the narration button 704 can bereplaced by a menu option, keyboard combination, voice command, or anyother input method. In similar fashion, the method of selecting portionsof the content to narrate can include cursor actions, menu options,touch screen gestures, voice commands, electronic pen input, or anyother input method.

FIG. 7B illustrates the browser interface of FIG. 7A in a narrationplayback mode. A user of a client computing device 102 can select theplayback button 712 when a network resource, such as a web page, with anassociated narration has been loaded. Because a consumer of a narrationmay be visually impaired, a method of receiving voice commands may beimplemented so that the user can request web pages and narrations,activate hyperlinks, and perform other input verbally. The browserinterface 700 may display visual indicators to the user when narrationis available for a web page. For example, the title bar 714 may includean icon, the playback button 712 may normally be hidden and only madevisible when a narration is available, etc.

During narration playback mode, some indication may be displayed on thebrowser interface 700 to inform the user which portion of the content isbeing described. For example, a highlight box 722 may appear aroundtextual content being read to the user, or a link may be outlined 716 orotherwise highlighted to indicate to the user that a portion of thecontent is being generally described rather than read verbatim. In someembodiments, a user may be able to interact directly with the content asthough there were no narration, even while narration playback isoccurring. A user may position the mouse cursor 718 over a link andclick the link, thereby loading a different page of content, even whilenarration playback is occurring with respect to the original contentpage. Some content may include dynamically changing portions, such asdynamic portion 720. For example, a news web site may include a “topstories” section which updates on regular basis, sometimes in real timeas events happen. The narration of such a portion may accordingly be outof date and inaccurate when played back at a later time. Therefore, insome embodiments a method may be included to determine whether a portionof the resource been altered since the narration was created.

FIG. 7C illustrates a browser interface 700 for interacting withnarrated content. The interface can include a hovering activation link724 for initiating playback of a narration, rather than the playbackbutton 712 of FIG. 7B. Additionally, instead of the normal mouse cursor718 of FIG. 7B, the interface of FIG. 7C can display a cursor 726 whichindicates to the user that the browser is currently in narrationplayback mode. In some cases, the cursor 726 can be a visual componentof the narration, and can indicate the position of the narrator's cursoron the screen during narration creation. FIG. 7C also illustrates analtered dynamic portion 720, when compared to the browser of FIG. 7B.When the user selects the dynamic portion 720 for narration playback,whether by clicking, highlighting, etc., the browser 700 or networkcomputing provider 107 can determine whether there has been a change inthe content within the dynamic portion 720 since the narration wascreated, as described in detail below. In response to determining thatthere has been a change to the content within the selected dynamicportion 720, the network computing provider 107 may provide an updatednarration. For example, the network computing provider 107 may provide amore recently created narration for the dynamic portion 720, may providea warning that the narration may be out of date, may remove the out ofdate portion from the narration, and the like.

FIG. 8 is a diagram depicting illustrative browser content processingactions as a series of processing subsystems 800. In many embodiments, abrowser may process sets of content (e.g., network resources, such asweb pages and associated embedded resources) in a series of processingactions. Illustratively, and as described above with reference to FIGS.3-5, a remote session browsing configuration may specify a split betweenprocessing actions performed at a network computing provider (e.g., anNCC POP) and processing actions performed at a client computing device102. This split may designate some processing actions to be performed byeach of the NCC POP and client computing device 102, or may assign allprocessing actions to a single device or component. For example, an NCCPOP may perform all of these various processing actions at the browsesession instance, and send fully processed RDP processing results to theclient computing device 102 for bitmap assembly and display. Any numberof different remote session browsing configurations may be used by oneor more browse sessions instances running at an NCC POP.

One of skill in the relevant art will appreciate that the subsystemsshown here are depicted for the purpose of illustration, and are notintended to describe a necessary order or a definitive list of browsersubsystems. Various browser software components may implement additionalor fewer browser subsystems than are shown here, and may order thesubsystems or corresponding processing actions in any number ofdifferent ways. Although the processing subsystems 800 depicted here forpurposes of illustration are directed at the processing of Web pages orother Web content, one of skill in the relevant art will appreciate thatthe processing of other file types or network resources may be broken upin a similar manner. For example, one of skill in the relevant art willappreciate that a similar schema may be developed for the processing ofimages, video, audio, database information, 3d design data, or any otherfile format or type of data known in the art. Similar schema may also bedeveloped for any number of device operating system or softwareframework processing operations, such as scheduling, memory or filemanagement, system resource management, process or service execution ormanagement, etc. Further, although the HTML protocol and RDP remotesession communication protocols are discussed herein for the purposes ofexample, one of skill in the relevant art will appreciate that a remotesession browsing configuration may implement any number of remotecommunication protocols for any number of specified processing actions,and that a remote session browsing configuration may be formulated toperform any fraction or combination of the actions identified below atany combination of the client computing device 102 and network computingprovider 107.

Illustratively, the first processing subsystem involved in theprocessing and display of network content is the networking subsystem802. Illustratively, the networking subsystem 802 may be responsible forall communication between the browser and content provider, includinglocal caching of Web content. The networking subsystem is generallylimited by the performance of the user's network. A remote sessionbrowsing configuration that splits processing actions at the networkingsubsystem 802 might include a remote session browsing configurationutilizing an HTML remote session communication protocol, where one ormore caching or resource retrieval actions were performed at the NCCPOP, but parsing and processing of the content was performed at theclient computing device.

As network resources, such as HTML documents are downloaded from theserver they may be passed to an HTML subsystem 804 which parses thedocument, initiates additional downloads in the networking subsystem,and creates a structural representation of the document. Modern browsersmay also contain related subsystems which are used for XHTML, XML andSVG documents. A remote session browsing configuration that splitsprocessing actions at the HTML subsystem 804 might include a remotesession browsing configuration utilizing an HTML remote sessioncommunication protocol, where an initial HTML page is processed at theNCC POP in order to extract embedded resource identifiers, butadditional parsing and processing of the content is performed at theclient computing device. In another embodiment, a remote sessionbrowsing configuration that splits processing actions at the HTMLsubsystem 804 might perform initial processing to create the structuralrepresentation of the HTML document, and provides a processing resultincluding the structural representation and associated embeddedresources to the client computing device for processing.

When CSS is encountered, whether inside an HTML document or an embeddedCSS document, it may be passed to a CSS subsystem 806 to parse the styleinformation and create a structural representation that can bereferenced later. Illustratively, a remote session browsingconfiguration that splits processing actions at a CSS subsystem 806 mayconstruct a processing result including the CSS structuralrepresentation and HTML structural representation, and provide theprocessing result and associated embedded resources to the clientcomputing device for processing.

HTML documents often contain metadata, for example the informationdescribed in a document header or the attributes applied to an element.The collections subsystem 808 may be responsible for storing andaccessing this metadata. A remote session browsing configuration thatsplits processing actions at a collections subsystem 808 may construct aprocessing result including processed metadata along with any otherstructural representations discussed above, and provide the processingresult and associated embedded resources to the client computing devicefor processing.

When Javascript is encountered, it may be passed directly to aJavaScript subsystem 810 responsible for executing the script. TheJavascript subsystem 810 has been examined fully over the years, and maybe one of the most well known browser subsystems in the art. A remotesession browsing configuration that splits processing actions at aJavascript subsystem 810 may construct a processing result including aninternal representation of one or more Javascript scripts, including,but not limited to state data or a representation of the script in anative or intermediate form, as well as any other processed structuresor data discussed above, and provide the processing result andassociated embedded resources to the client computing device forprocessing.

Because many JavaScript engines are not directly integrated into thebrowser, there may be a communication layer including the marshallingsubsystem 812 between the browser and the script engine. Passinginformation through this communication layer may generally be referredto as marshaling. A remote session browsing configuration that splitsprocessing actions at a marshalling subsystem 812 may construct aprocessing result including marshalling data as well as any otherprocessed structures, scripts, or data discussed above, and provide theprocessing result and associated embedded resources to the clientcomputing device for processing.

In some embodiments, JavaScript interacts with an underlying networkresource such as a Web document through the Document Object Model APIs.These APIs may be provided through a native object model subsystem 814that knows how to access and manipulate the document and is the primaryinteraction point between the script engine and the browser.Illustratively, a remote session browsing configuration that splitsprocessing actions at a native object model subsystem 814 may constructa processing result including native object model state data or APIcalls as well as any other processed structures, scripts, or datadiscussed above, and provide the processing result and any otherassociated embedded resources to the client computing device forprocessing.

Once the document is constructed, the browser may needs to apply styleinformation before it can be displayed to the user. The formattingsubsystem 816 takes the HTML document and applies styles.Illustratively, a remote session browsing configuration that splitsprocessing actions at a formatting subsystem 816 may construct aprocessing result including an HTML representation with applied styles,as well as any other processed state data, API calls, structures,scripts, or data discussed above, and provide the processing result andany other associated embedded resources to the client computing devicefor processing.

In one embodiment, CSS is a block based layout system. After thedocument is styled, the next step, at a block building subsystem 818,may be to construct rectangular blocks that will be displayed to theuser. This process may determine things like the size of the blocks andmay be tightly integrated with the next stage, layout. A remote sessionbrowsing configuration that splits processing actions at a blockbuilding subsystem 818 may construct a processing result including blockinformation, as well as any other processed state data, API calls,structures, scripts, or data discussed above, and provide the processingresult and any other associated embedded resources to the clientcomputing device for processing.

Subsequent to the browser styling the content and constructing theblocks, it may go through the process of laying out the content. Thelayout subsystem 820 is responsible for this algorithmically complexprocess. Illustratively, a remote session browsing configuration thatsplits processing actions at a layout subsystem 820 may process thevarious state data, API calls, structures, scripts, or data discussedabove to construct a processing result including layout information forthe client computing device. Illustratively, an NCC POP may make use ofvarious data or settings associated with the client computing device orbrowser (e.g., as provided in the initial browse session request) inorder to generate a suitable layout for the client computing device. Forexample, a mobile device may provide a screen resolution and a displaymode to the NCC POP. The NCC POP may base layout calculations on thisscreen resolution and display mode in order to generate a processingresult corresponding to a content representation suitable for a browserrunning on the mobile device. Illustratively, in various embodiments,any other subsystem implemented by the NCC POP may make use of dataassociated with the client computing device or browser in generating aprocessing result for the client.

The final stage of the process may occur inside the display subsystem822 where the final content is displayed to the user. This process isoften referred to as drawing. A remote session browsing configurationthat splits processing actions at the networking subsystem 802 mightinclude a remote session browsing configuration utilizing an RDP remotesession communication protocol, where nearly all processing is performedat the NCC POP, and a processing result including bitmap data and lowlevel interface data are passed to the client computing device fordisplay.

FIG. 9 is a flow diagram illustrative of a new browse session routine900 implemented by network computing provider 107 of FIG. 1. New browsesession routine 900 begins at block 902. At block 904, the networkcomputing provider 107 receives a new browse session request from clientcomputing device 102. As previously described, the client computingdevice 102 may load a browser for viewing network content in response toan event or user request. Subsequent to the browser being loaded, thebrowser may be implemented request a new browse session. From theperspective of the user of the client computing device, the request forthe new browse session corresponds to the intended request to transmitthe request to one or more corresponding content providers 104.Illustratively, this request may be generated automatically as a resultof the browser loading (e.g., a request for a default or “home” page),or may be generated as a result of a user following a link or entering anetwork address into an address bar. This browse session request mayinclude one or more addresses or references to various network resourcesor other content requested by the client computing device 102. In anillustrative embodiment, the browse session request is transmitted inaccordance with an API.

At block 906 the network computing provider 107 may select an associatedNCC POP to instantiate a new browse session based on the browse sessionrequest. As discussed above with reference to FIG. 1, a networkcomputing provider 107 may include any number of NCC POPs distributedacross any number of physical or logical locations. A network computingprovider 107 may select a NCC POP to service a browse session requestbased on any number of factors, including, but not limited to availableNCC POP resources (e.g., available memory, processor load, network load,etc.), a financial cost of servicing the browse session request at theNCC POP, the NCC POP location respective to a client computing device102, content provider 104, or CDN POP 116, a NCC POP cache status (e.g.,whether a requested resource is already stored in an NCC POP cache),etc.

In one embodiment, the network computing provider 107 may select anumber of NCC POPs to service a browse session request. For example, thenetwork computing provider 107 may select two NCC POPs with differentlogical locations in the network. Each NCC POP may independently requestand process network content on the behalf of the client computing device102, and the client computing device 102 may accept data from the firstNCC POP to return a processing result. Subsequent to being selected bythe network computing provider 107, NCC POP 142 may obtain the browsesession request. In one embodiment, NCC POP 142 may have the browsesession request forwarded to it by a component of network computingprovider 107. In another embodiment, NCC POP 142 or client computingdevice 102 may receive connection information allowing the establishmentof direct communication between NCC POP 142 and client computing device102. Illustratively, NCC POP 142 may be provided with the browse sessionrequest originally provided to network computing provider 107, may beprovided with a subset of information (e.g., just a network address ofrequested content), or may be provided additional information notincluded in the original browse session request.

Subsequent to the NCC POP 142 being selected, the network computingprovider 107 may cause the NCC POP 142 to instantiate a new browsesession. Illustratively, instantiating a new browse session instance mayinclude loading a new virtual machine instance and/or browser instanceat the NCC POP 142, reserving or allocating device memory, storage orcache space, processor time, network bandwidth, or other computationalor network resources for the new browse session. Illustratively, one ormore characteristics of the new browse session instance and/or browserinstance may be based on client computing device 102 informationincluded in the browse session request. For example, the browse sessionrequest may include a device type or browser type, a device screenresolution, a browser display area, or other information defining thedisplay preferences or capabilities of the client computing device 102or browser. The NCC POP 142 may accordingly instantiate a virtualmachine instance and/or a browser instance with the same or similarcapabilities as the client computing device 102. Illustratively,maintaining a virtual machine instance and/or browser with the same orsimilar capabilities as the client computing device 102 may allow theNCC POP 142 to process network content according to the appropriatedimensions and layout for display on the particular client computingdevice 102.

In some embodiments, the NCC POP 142 may utilize an existing virtualmachine instance and/or browser instance in addition to, or as analternative to, instating a new browse session. For example, subsequentto the NCC POP 142 being selected, the network computing provider 107may cause the NCC POP 142 to associate an existing browser instanceand/or virtual machine instance, such as one or more instancespreviously instantiated at the NCC POP 142, with the new browse sessionrequest. Illustratively, an existing browser session and/or virtualmachine instance may correspond to another browse session, remoteapplication session, or other remote process associated with the user orclient computing device 102, or may be a previously instantiatedsoftware instance from an unrelated browse session or remote process. Inother embodiments, the NCC POP 142 may instantiate a new browser orother application process in an existing virtual machine instance, ormay combine the utilization of previously instantiated and newlyinstantiated software processes in any number of other ways. In stillfurther embodiments, the network computing provider or NCC POP 142 mayinstantiate any number of new virtual machine instances and/or browserinstances (or make use of existing instantiated instances) based on asingle browse session request.

At block 908 the network computing provider 107 may provide a requestfor one or more network resources to a content provider or CDN serviceprovider based on a network address included in the browse sessionrequest. In various embodiments, one or more network resources may beadditionally or alternately retrieved from a cache local to the NCC POP142 or otherwise associated with the network computing provider 107. Oneof skill in the art will appreciate that, in the case of otherembodiments, the link or network address may correspond to a document orfile stored in a digital file locker or other network storage locationor at a cache component associated with the network computing provider107 or client computing device 102. In some embodiments, the new sessionrequest may include a document or file in addition to or as analternative to a network address. At block 910, the network computingprovider 107 obtains the one or more network resources. Subsequent toobtaining the requested network resource, the NCC POP 142 may processthe network resource to extract embedded resource identifiers.

At block 912, the network computing provider 107 may provide resourcerequests to one or more sources of content such as content providers,CDN service providers, and caches. The resource requests may correspondto embedded resources based on the one or more embedded resourceidentifiers extracted from the one or more network resource as describedin block 910 above. At block 914, the network computing provider 107 mayobtain these embedded resources from any number of different sources,sequentially or in parallel.

At block 916, the network computing provider 107 may process the one ormore network resources and associated embedded resources to determine aremote session browsing configuration for the processing andcommunication of content to the client computing device 102. A remotesession browsing configuration may include any proprietary or publicremote protocol allowing exchange of data and user interactions orrequests between a client and a remote server. The remote sessionbrowsing configuration may illustratively include both a remote sessioncommunication protocol and a processing schema for providing processed(or unprocessed) content to a client computing device for display in thecontent display area of a browser.

Illustratively, a remote session browsing configuration may define orspecify a remote session communication protocol, including, but notlimited to, a network protocol, signaling model, transport mechanism, orencapsulation format for the exchange of state data, user interactions,and other data and content between the network computing provider andthe client computing device. Examples of remote session communicationprotocols known in the art include Remote Desktop Protocol (RDP),X-Windows protocol, Virtual Network Computing (VNC) protocol, RemoteFrame Buffer protocol, HTML, etc. For example, RDP illustrativelyspecifies a number of processing mechanisms for encoding client input(e.g., mouse movement, keyboard input, etc.) into protocol data unitsfor provision to a remote computing device, and corresponding mechanismsfor sending bitmap updates and low level interface information back tothe client device. As another example, the HTML protocol illustrativelyprovides a mechanism for providing files defining interface informationand containing resources references from a server to a client, and acorresponding mechanism for a client computing device to providerequests for additional files and resources to the server. In oneembodiment, the NCC POP 142 may provide an initial communication to theclient computing device 102 after determining the remote sessioncommunication protocol. This initial communication may allow the clientcomputing device 102 to prepare to receive communications in theselected remote session communication protocol, and, in the case of pullremote session communication protocols like HTTP, may cause the clientcomputing device to send an initial resource request to the browsesession instance running on the NCC POP 142.

Each remote session browsing configuration may additionally define asplit of processing actions between the network computing and storageservice (e.g., NCC POP 142) and the client computing device (e.g.,client computing device 102). In one embodiment, a particular split ofprocessing actions may be based on or mandated by a particular remotesession communication protocol. In another embodiment, a remote sessioncommunication protocol may allow several different splits of processingactions depending on the implementation or configuration of theprotocol. For the purpose of illustration, many pieces of networkcontent (e.g., Web pages, video, Flash documents) may require variousprocessing actions before being displayed on a computing device. A Webpage, for example, may be parsed to process various HTML layoutinformation and references to associated resources or embedded contentsuch as CSS style sheets and Javascript, as well as embedded contentobjects such as images, video, audio, etc. The HTML and each referencedobject or piece of code will typically be parsed and processed before arepresentative object model corresponding to the Web page may beconstructed. This object model may then be processed further for layoutand display in a content display area of a browser at the clientcomputing device 102. Illustrative browser processing actions aredescribed in greater detail below with reference to FIG. 8. One of skillin the art will appreciate that, in the case of other embodiments orapplications, various other processing actions may be required.

A remote session browsing configuration may specify that various of theprocessing actions required for display of piece of network content beperformed at the remote computing device, such as the NCC POP 142,rather than at the client computing device 102. Network contentpartially (or wholly) processed at the network computing provider may bereferred to as a processing result. As discussed below, the split ofprocessing actions may be associated with or linked to the remotesession communication protocol used for exchanging data and client inputbetween the NCC POP 142 and client computing device 102.

For example, a remote session communication protocol such as RDP thattransmits a processing result including low level interface informationand bitmaps to the client computing device 142 for display may beassociated with a remote session browsing configuration that specifiesperforming all, or nearly all, of the necessary content processingactions at the NCC POP 142. While using RDP, the NCC POP 142 may, forexample, run a full instance of a browser the NCC POP 142 and transmit aprocessing result consisting of bitmap updates corresponding to arepresentation of the displayed content to the client computing device102. The client computing device 102, in this example, may merely berequired to assemble the transmitted bitmap updates for display in thecontent display area of the browser, and may perform none of theprocessing of the actual HTML, Javascript, or data objects involved inthe display of an illustrative piece of network content. As anotherexample, a remote session browsing configuration utilizing a remotesession communication protocol such as HTML may transmit network contentin a largely unprocessed form. The client computing device 102 may thusperform all of the processing actions required for display of networkcontent while the NCC POP 142 performs little or no processing.

The NCC POP 142 may base its determination of a remote session browsingconfiguration on any number of factors, including, but not limited to,one or more characteristics of one or more of the requested resources,content provider 104, or CDN service provider 106, one or morecharacteristics of the content address or domain, one or morecharacteristics of the client computing device 102, browser orapplication, user, one or more characteristics of the NCC POP 142, orone or more characteristics of the network or network connection, etc.Characteristics of requested resources may include, but are not limitedto, a data format, a content type, a size, processing requirements,resource latency requirements, a number or type of interactive elements,a security risk, an associated user preference, a network address, anetwork domain, an associated content provider, etc. Characteristics ofa content provider 104, CDN service provider 106, computing device 102,or NCC POP 142 may include, but are not limited to, processing power,memory, storage, network connectivity (e.g., available bandwidth orlatency), a physical or logical location, predicted stability or risk offailure, a software or hardware profile, available resources (e.g.,available memory or processing, or the number of concurrently opensoftware applications), etc. The NCC POP 142 may further considerperceived security threats or risks associated with a piece of contentor domain, preferences of a client computing device or a contentprovider, computing or network resource costs (e.g., a financial cost ofprocessing or bandwidth, resource usage, etc.), predeterminedpreferences or selection information, any additional processing overheadrequired by a particular remote session browsing configuration, a cachestatus (e.g., whether a particular resources is cached at a NCC POP 142,at the client computing device 102, or at other network storageassociated with the network computing provider), a predicted delay ortime required to retrieve requested network content, a preferred contentprovider or agreements with a content provider for a particular remotesession browsing configuration or level of service, a remote sessionbrowsing configuration being used for another (or the current) browsesession by the same user, or any other factor.

In some embodiments, an NCC POP 142 may base a determination of a remotesession browsing configuration on past behavior or practice. Forexample, an NCC POP 142 that has determined a remote browse sessionconfiguration for a particular resource in the past may automaticallyselect the same remote browse session configuration when the resource isrequested by the same (or potentially a different) user. As anotherexample, a user that has a history of frequently accessing Web siteswith extensive processing requirements may automatically be assigned aremote session browsing configuration that performs the majority ofprocessing at the NCC POP 142. In other embodiments, an NCC POP 142 maybase a determination of a remote browse session configuration onpredictions of future behavior. For example, an NCC POP 142 may base itsdetermination of a remote browse session configuration for a particularresource on an analysis of past determinations made for a particular Website, network domain, or set of related resources. A content providerthat historically has provided video-heavy Web pages may be associatedwith a remote session browsing configuration that emphasizes videoperformance at the client computing device 102. Illustratively, pasthistorical analysis and future predictions may be considered as one ormore of a number of factors on which to base the remote session browsingconfiguration determination process, or may be definitive in thedecision making process. For example, once an NCC POP 142 determines aremote session browsing configuration for a particular content provider,it may skip the remote session browsing configuration determinationprocess for any future resources served from the content provider.Illustratively, the NCC POP 142 may re-determine a remote sessionbrowsing configuration to be associated with the content provider aftera fixed period of time, or after the NCC POP 142 has identified ordetermined a change in the content being served by the content provider.

In other embodiments, a network resource, Web site, network domain,content provider, or other network entity may specify or otherwiserequest the use of a particular remote browse session configuration in aresource tag, metadata, or other communication with an NCC POP 142. TheNCC POP 142 may treat the request as definitive, or may consider therequest as one of multiple factors to be considered in the decisionmaking process.

For example, a remote session browsing configuration utilizing a remotesession communication protocol such as RDP may specify extensiveprocessing to occur at the network computing provider 107 (e.g., at NCCPOP 142) rather than at the client computing device 102. The remotesession browsing configuration may thus leverage the processing power ofthe NCC POP 142 to achieve lower latencies and presentation delay whendealing with network content that requires a great deal ofpre-processing (e.g., content with a great deal of CSS or Javascriptinformation defining page layout). The NCC POP 142 may therefore selecta remote session browsing configuration that performs a substantialamount of processing at the network computing provider 107 and utilizesRDP or a similar remote session communication protocol for communicationof processing-intensive content. Conversely, a remote session browsingconfiguration that utilizes a remote session communication protocol suchas HTML may specify extensive processing at the client computing device102 rather than at the network computing provider 107. The remotesession communication protocol may thus achieve smaller delays andsmoother presentation when presented with simple network content thatrequires very little processing or network content that requires rapidchange in displayed content after its initial load. For example, a Webpage with embedded video may perform better performing the majority ofprocessing locally and utilizing HTML rather than RDP as a remotesession communication protocol. A remote session browsing configurationspecifying extensive processing at the network computing provider 107must process the video at the NCC POP 142 and rapidly send screenupdates (e.g. by RDP) to the client computing device 102, potentiallyrequiring a great deal of bandwidth and causing choppy playback in thebrowser, while a remote session browsing configuration specifying localprocessing may provide raw video information directly to the clientcomputing device 102 for display (e.g. by HTML), allowing for clientside caching and a smoother playback of content.

As a further example, the NCC POP 142 in communication with a clientcomputing device 102 with extremely limited processing power may electto use a remote session browsing configuration that requires very littleprocessing by the client computing device, for example, using RDP totransmit NCC POP 142 processed results. Conversely, an NCC POP 142providing an extremely interactive Web page may elect to use a remotesession browsing configuration that allows the client computing device102 to handle user interactions locally in order to preserve interfaceresponsiveness, for example, using HTML to transmit substantiallyunprocessed data. As a still further example, a NCC POP 142 may base thedetermination of a remote session browse configuration on preferencesprovided by the client computing device 102. A client computing device102 may illustratively include preferences for a remote session browseconfiguration in an initial browse session request, or at any othertime. The NCC POP 142 may utilize these preferences as an alternativeto, or in addition to any other factor or decision metric.Illustratively, allowing the client computing device 102 to set orinfluence the selection of a remote session browse configuration allowsthe NCC POP 142 to take user preferences in account when determining aremote session browse configuration. For example, a user worried aboutinitial page load times may prefer to use a remote session browsingconfiguration heavy on remote processing and utilizing an RDP remotesession communications protocol, while a user wishing to maintain anextremely responsive interface may prefer using a remote sessionbrowsing configuration that performs the majority of the processing onthe client computing device 102, for example, using an HTML remotesession communication protocol.

Illustratively, the NCC POP 142 may base a determination of a remotebrowsing configuration on any factor or combination of factors. Forexample, the NCC POP 142 may select a remote session browsingconfiguration based on a single factor, or may assign weights to one ormore factors in making a determination. In some embodiments, thedetermination process of the NCC POP 142 may change based on one or morefactors described above. For example, an NCC POP 142 communicating witha client computing device 102 over a network with a surplus of unusedbandwidth may give a low weight to factors such as the networkrequirements of a remote browse session, and may give a higher weight tofactors such as the latency of page interactions, while an NCC POP 142communicating with a client computing device 102 over a limitedbandwidth network may give a higher weight to factors dealing with theefficiency of the remote session browse protocol over a network.

In one embodiment, the NCC POP 142 may select a single remote sessionbrowsing configuration for a set of network content. For example, theNCC POP 142 may select a single remote session browsing configurationfor a requested network resource such as a Web page. The NCC POP 142 maythus process the Web page together with all embedded content based onthe selected remote browsing session protocol, and utilize the remotebrowsing session protocol to exchange user interaction data and updatedbrowse session data for all embedded content associated with the Webpage. In another embodiment, the NCC POP 142 may select different remotesession browsing configurations for one or more resources in a set ofnetwork content. For example, a network resource such as a Web page mayreference processing intensive embedded Javascript or CSS resources, aswell as embedded video resources. The NCC POP 142 may select a firstremote session browsing configuration for the Web page and all embeddedresources excluding the embedded video resource, and a second remotesession browsing configuration for the embedded video resource.Illustratively, this may result in the NCC POP 142 utilizing RDP to senda processing result to the client computing device 102 for display ofthe Web page and associated embedded resources, while utilizing HTTP tosend the embedded video as a separate, unprocessed file. In oneembodiment, the client computing device 102 may perform the minimalprocessing required to display the RDP processing result correspondingto the Web page and embedded resources, and may also perform additionalprocessing necessary to display the embedded video, for example,overlaying the video on top of the displayed RDP representation of theWeb page. Any number of remote session browsing configurations may beselected to correspond to any number of resources or objects included ina set of network content, regardless of whether resources or objects areobtained from a content provider 104 or CDN service provider 106 in oneor more logical files or data structures.

Although the selection of a remote session browsing configuration isillustratively depicted herein as occurring after all network resourcesand associated embedded content have been obtained by the NCC POP 142,one skilled in the relevant art will appreciate that the selection of aremote session browsing configuration may be performed at any time. Forexample, the NCC POP 142 may select a remote session browsingconfiguration after receiving a new browse session request or relatedinformation from the client computing device, may select a remotesession browsing configuration after obtaining a network resource, butbefore obtaining any associated embedded resources, or at any othertime. In some embodiments, the NCC POP 142 may switch to a new remotesession browsing configuration at some time subsequent to the clientcomputing device 102 obtaining an initial processing result.Illustratively, the NCC POP 142 selecting a new remote session browsingconfiguration may occur automatically after a certain time period orevent or in response to a change in network conditions, NCC POP 142 orclient computing device 102 load or computing resources, or any otherfactor described above as potentially influencing the choice of remotesession browsing configuration. Illustratively, an NCC POP 142 dealingwith other types or formats of information may select a remote sessionprotocol based on any number of similar factors. For example, one ofskill in the relevant art will appreciate that a similar schema may bedeveloped for the processing of images, video, audio, databaseinformation, 3d design data, or any other file format or type of dataknown in the art.

The client computing device 102 may, in various embodiments, furtherinstantiate a parallel browsing process sequentially or simultaneouslywith the request for a remote browse session. In one embodiment, aclient computing device 102 may instantiate a traditional local browsesession as known in the art (e.g., providing content requests from thebrowser and processing obtained resources locally) in addition to one ormore remote browse instance executing at an NCC POP 142. In anotherembodiment, a client computing device 102 may be provided withunprocessed network resources by the NCC POP 142. Illustratively, thenetwork resources may have been retrieved from one or more contentproviders, CDNs, or cache components by the NCC POP 142. The resourcesmay be provided to the client computing device 102 to process locally inparallel with the remote browse instance executing at the NCC POP 142.In still further embodiments, the network computing provider or NCC POP142 may instantiate any number of new virtual machine instances and/orbrowser instances (or make use of existing instantiated instances) toprocess resources and/or send processing results to the client computingdevice 102 in parallel. Illustratively, the local browse session at theclient computing device 102 and the remote browse session instance atthe NCC POP 142 may execute in parallel.

In one embodiment, a local browse session executing at the clientcomputing device 102 may obtain unprocessed content (e.g., html Webpages, embedded content, and other network resources) from the NCC POP142 responsive to a browse session request. Illustratively, the contentmay have been retrieved by the NCC POP 142 from a content provider, CDN,or cache in response to the browse session request. The unprocessedcontent provided by the NCC POP 142 may include all the contentassociated with the browse session request or may supplement contentexisting in a cache of the client computing device, retrieved from acontent provider or CDN, or obtained from some other source. In oneembodiment, a client computing device 102 may obtain all requestedcontent from a local cache, and may not obtain any unprocessed resourcesor content from the NCC POP 142. Subsequent to obtaining the unprocessedcontent, client computing device 102 may process the requested contentin parallel with a remote browse session executing at the NCC POP 142.For example, as the local browse session executing at the clientcomputing device 102 is processing the requested content, a remotebrowse session executing at the NCC POP 142 may be processing the samecontent at substantially the same time. Once the NCC POP 142 hasperformed a set of processing actions on the content to generate aprocessing result (e.g., as specified by a determined remote sessionbrowsing configuration), the NCC POP 142 may provide the processingresult to the client computing device 102.

For the purpose of illustration, a client computing device 102 mayrequire a longer load time to obtain and process requested networkresources than a browse session instance running at the NCC POP 142. Forexample, the NCC POP 142 may obtain and process content quickly due toits position on the network and the relative processing power of thelocal client computing device as compared to the NCC POP 142. Even ifthe NCC POP 142 provides the client computing device 102 with allrequested network content, the client computing device 102 may stillobtain a processing result from NCC POP 142 before the local browsesession has fully completed processing the requested resources. Theclient computing device 102 may complete any further processing stepsand display the obtained processing result before completing localprocessing and display of the content. Illustratively, this may allowthe client computing device 102 to take advantage of an NCC POP 142'squicker content load time relative to a traditional local browsesession. Prior to the local browse session completing the processing allrequested resources, the browser may process any user interactionslocally and/or remotely as described in FIGS. 5A and 11 below.

Once the local browse session has fully obtained and processed resourcescorresponding to the requested content, the computing device 102 maydetermine whether to continue to display results obtained from the NCCPOP 142 (and process user interactions at the NCC POP 142) using thedetermined remote session browsing configuration or switch to processinguser interactions locally. Switching to process user interactionslocally may include replacing a displayed representation of therequested resources based on a processing result obtained from the NCCPOP 142 with a local display of the requested resources. For example, abrowser may display a representation of a Web page corresponding to aprocessing result from the NCC POP 142 (e.g., RDP display informationrepresenting the rendered page) until the browser is finished processingand rendering the Web page locally. The browser may then replace therepresentation from the NCC POP 142 with the locally renderedrepresentation of the Web page. Illustratively, replacing onerepresentation with another representation may be transparent to theuser. For example, the local and NCC POP 142 representations of the Webpage may be identical or substantially identical. In one embodiment,when the NCC POP 142 representation of the web page is displayed, thebrowser may send various user interactions with the displayed page tothe NCC POP 142 for processing. When the locally rendered version of theWeb page is displayed, user interactions may be processed locally at thebrowser. Illustratively, the determination of which representation ofthe requested resources to display (e.g., local or from the NCC POP 142)may be based on any of the same factors described with reference todetermining a remote session browse protocol in above.

In one embodiment, the client computing device 102 may switch toprocessing user interactions locally as soon as local resources arefully loaded. Illustratively, the remote browse session instance runningat the NCC POP 142 may be terminated after switching to localprocessing, or the remote browse session instance may be maintained as abackup in case of unresponsiveness or a failure with regards to thelocal browse session. For example, the client computing device 102 mayprocess user interactions locally, as well as sending remote userinteraction data to the NCC POP 142 in accordance with the selectedremote session browsing configuration. The remote user interaction datamay be used by the NCC POP 142 to keep the remote browse sessioninstance fully in parallel with the local browse process being executedby the browser at the client computing device 102. As long as the localbrowse session continues to handle user interactions, the NCC POP 142may either refrain from sending updated processing results, or may sendupdated processing results ignored by the client computing device 102.If a problem develops with the local browse session at the clientcomputing device 102, updated processing results may be provided to theclient computing device 102 from the NCC POP 142 for processing anddisplay in lieu of the local browse session. Illustratively, this switchfrom the local browse session to remote processing may be transparent tothe user. In some embodiments, the client computing device 102 mayswitch from a local browse session to a remote browse session instancebased on factors other than unresponsiveness or failure at the localbrowser. For example, the client computing device 102 or networkcomputing and storage component 107 may select between a remote andlocal browse session based on any of the factors enumerated with regardsto determining a remote session browse protocol above

In another embodiment, the client computing device 102 may continue toprocess and display updated processing results from the NCC POP 142 evenafter the local browse session has fully loaded the requested content.The client computing device 102 may terminate the local browse sessionor may run the local browse session in parallel as a backup process inthe converse of the example provided above. It should be appreciatedthat although the local browse session is described here for the purposeof illustration as being slower to load than the remote browse sessioninstance, in some embodiments the local browse session may load thecontent faster than the remote browsing session, in which case thebrowser may process user interactions locally until the remote browseprocess has fully loaded the requested content. In some embodiments, theclient computing device 102 may display and process user interactionsthrough whichever browse session, local or remote, loads the requestedcontent first.

In various other embodiments, the network computing provider 107 mayinstantiate multiple remote browse session instances to run in parallelin addition to or as an alternative to instantiating a local browsesession. Illustratively, these parallel browse session instances mayutilize any of the same or different remote session browse protocols,and may act as backups in the manner described above with regard to alocal browse session, or may be used and switched between asalternatives in order to maximize browser performance at the clientcomputing device 102. For example, in response to one or more browsesession requests, the network computing provider 107 may instantiate abrowse session instance running on a first NCC POP and utilizing an RDPprotocol as well as browse session instance running on a second NCC POPutilizing an X-Windows protocol. The client computing device 102 or thenetwork computing provider 107 may determine which browse sessioninstance and protocol should be used based on performance or resourceusage considerations as described with regards to determining a remotesession browse protocol above.

With continued reference to FIG. 9, at block 918, the network computingprovider 107 may process the obtained content, including the one or morerequested network resources and embedded network resources, according tothe determined remote session browsing configuration to generate aninitial processing result. At block 920, the network computing provider107 may provide the initial processing result to the client for furtherprocessing and display in the content display area of the browser. Forthe purposes of further example, an illustrative client new browsesession interaction routine 1000 implemented by client computing device102 is described below with reference to FIG. 10. At block 922, thestart new browse session routine 900 ends.

FIG. 10 is a flow diagram illustrative of a client new browse sessioninteraction routine 1000 implemented by client computing device 102. Newbrowse session interaction routine 1000 begins at block 1002 in responseto an event or user request causing the client computing device 102 toload a browser for viewing network content. At block 1004, the clientcomputing device loads locally managed components of the browser,including all local interface components. As described above withreference to FIGS. 5A and 7, local interface components may includetoolbars, menus, buttons, or other user interface controls managed andcontrolled by the software browser application or any other processexecuting or implemented locally at the client computing device. Atblock 1006, the client computing device 102 provides a request for a newbrowse session instance to the network computing provider 107. From theperspective of the user of the client computing device, the request forthe new browse session corresponds to the intended request to transmitthe request to one or more corresponding content providers 104. In otherembodiment, the new session request may correspond to a request to loada file or other document (e.g., a request to load an image in aphoto-editing application, etc.). Illustratively, the request may begenerated automatically as a result of the browser loading (e.g., arequest for a default or “home” page), or may be generated as a resultof a user following a link or entering a network address into an addressbar. As illustrated with respect to FIG. 2, the browse session requestis transmitted first to a network computing provider 107. In anillustrative embodiment, the network computing provider 107 utilizes aregistration API to accept browse session requests from the clientcomputing device 102.

A browse session request may include any number of pieces of data orinformation including, but not limited to, information associated with auser, information associated with the client computing device 102 orsoftware on the client computing device (e.g., hardware or softwareinformation, a device physical or logical location, etc.), informationassociated with the network 108, user or browser preferences (e.g., arequested remote session browse protocol, a preference list, a decisiontree, or other information), information associated with the networkcomputing provider 107, information associated with one or more piecesof requested network content (e.g., the network address of a networkresource), etc. For example, a browse session request from the clientcomputing device 102 may include information identifying a particularclient computing device hardware specification or a hardware performancelevel, latency and bandwidth data associated with recent contentrequests, a desired security level for processing different types ofcontent, a predetermined preference list of remote session browseprotocols, and one or more network addresses corresponding to requestednetwork resources, among others. In another example, the browse sessionrequest can include information identifying a client computing device102 screen resolution, aspect ratio, or browser display area in thebrowse session request may allow the network computing provider 107 tocustomize the processing of network content for display on the clientcomputing device. As previously described, the browse session requestcan include network address information corresponding to a requestednetwork resource, which may be in any form including, but not limitedto, an Internet Protocol (“IP”) address, a URL, a Media Access Control(“MAC”) address, etc. In one embodiment, the request for a new browsesession instance may correspond to the network computing providerreceiving a request for a new browse session instance at block 904 ofFIG. 9 above.

At block 1008, the client computing device 102 obtains an initialprocessing result from the network computing provider 107.Illustratively, the format and data included in the initial processingresult may vary based on the remote session browsing configurationselected by the network computing provider 107. In one embodiment, theinitial processing result may include or be preceded by data informingthe client computing device 102 of the choice of remote session browsingconfiguration and/or establishing a connection over the remote sessioncommunication protocol corresponding to the selected remote sessionbrowsing configuration. As discussed above with reference to FIGS. 8 and9, the obtained initial processing result may include requested contentwith one or more processing actions performed by the network computingprovider 107. Subsequent to obtaining the initial processing result, theclient computing device 102 may perform any remaining processing actionson the initial processing result at block 1010.

At block 1012, the client computing device 102 displays the contentcorresponding to the processed initial processing result. For example,the client computing device 102 may display the processed client in thecontent display area 702 of a browser 700 as described in FIG. 7A above.In one embodiment, the processing result may only include display datacorresponding to content displayed by a browser, and may not includedisplay data corresponding to, for example, the interface controls of abrowser instance at the NCC POP 142, the desktop of a virtual machineinstance corresponding to the browse session, or any other userinterface of the NCC POP 142. For example, the NCC POP 142 may process aWeb page and associated content for display via RDP in a browserinstance running in a virtual machine instance at the NCC POP 142. Thebrowser instance may have one or more interface elements such astoolbars, menus, scroll bars, etc., in addition to the displayed Webpage. The NCC POP 142 may send an RDP processing result corresponding tothe displayed Web page only, without any of the interface elementsassociated with the browser. Illustratively, including an RDP processingresult corresponding to the displayed Web page only may allow thebrowser at the client computing instance 102 to display the Web page byassembling the RDP processing result in the content display area of thebrowser without any further processing. In another embodiment, the RDPprocessing result may include a full virtual machine desktop and browserwindow corresponding to the full interface displayed at the NCC POP 142browse session instance. The client computing device may automaticallyidentify the area of the RDP processing result corresponding to therequested content, and may display only this area in the content displayarea of the browser.

At block 1014, the client computing device 102 processes local andremote user interactions. An illustrative routine for processing userinteractions is provided below with reference to FIG. 11. At block 1016the routine ends. Illustratively, a browse session instance instantiatedby the network computing content provider 107 may terminate when abrowser window or content display area is closed, may terminate when aremote session browse protocol is replaced by a parallel process at theclient computing device 102, or may terminate in accordance with a timeror other event. Illustratively, if a browse session has terminatedautomatically due to a time-out but has associated content stilldisplayed in a browser at the client computing device 102, laterattempts by the user to interact with the content may result in a newbrowse session request being provided to the network computing andstorage service provider 107 to start a new browse session according tothe last state of the terminated session. Illustratively, terminating aremote browse session after a time-out may allow the network computingstorage provider 107 to save computing resources at the NCC POP. In oneembodiment, this process may be transparent to the user at clientcomputing device 102, even though the remote browse session has beenterminated during the intervening period.

FIG. 11 is a flow diagram illustrative of a process user interactionroutine 1100 implemented by a client computing device 102. Process userinteraction routine 1100 begins at block 1102 in response to aninteraction by a user. Illustratively, process user interaction routine1100 may begin subsequent to the display of content in a content displayarea of a browser interface. For example, process user interactionroutine 1100 may correspond to block 1014 of FIG. 10 above.

Illustratively, the displayed content may have one or more interactiveelements, such as forms, buttons, animations, etc. User interaction withthese interactive elements may require processing and display of updatedcontent in the content display area. For example, selecting an elementin a drop-down menu on a Web page may require processing and may changethe configuration or visual appearance of the Web page or embeddedresources. Illustratively, the processing required by user interactionwith the displayed content may be handled as a local user interaction atthe client computing device 102 or as a remote user interaction at theNCC POP 142 depending on the remote session browsing configuration inuse. For example, if a remote session browsing configuration utilizingsubstantial local processing (e.g., sending unprocessed files overHTML), user interactions with displayed content may typically be handledas local user interactions at the client computing device 102.Illustratively, handling user interactions with displayed content aslocal user interactions at the client computing device 102 may allow forbetter responsiveness and fewer delays with simple user interactions(e.g., selection of a radio button, or typing text into a field), asinteraction data corresponding to the interaction does not need to besent to the NCC POP 142 for processing.

As a further example, if a remote session browsing configurationutilizing heavy remote processing of content (e.g., sending processedbitmap data over RDP) is being used as the remote session browsingconfiguration, all user interactions with displayed content may behandled as remote user interactions. For example, user input (e.g.,keyboard inputs and cursor positions) may be encapsulated in RDPprotocol data units and transmitted across network 108 to the NCC POP142 for processing. Illustratively, the NCC POP 142 may apply the userinteractions to the network content and transmit processing resultsconsisting of updated bitmaps and interface data corresponding to anupdated representation of the content back to the client computingdevice 102. Illustratively, handling user interactions with displayedcontent as remote user interactions at the NCC POP 142 may have anegative impact on interface responsiveness, as data is required to passover the network and is limited by network latency; however, userinteractions that require a substantial amount of processing may performbetter when handled as remote user interactions, as the processinglatency of the NCC POP 142 may be substantially lower than theprocessing latency of the client computing device 102.

In addition to a content display area for displaying network content, abrowser may have one or more local interface components, such astoolbars, menus, buttons, or other user interface controls. Interactionswith local interface components may be treated as local userinteractions or remote user interactions depending on the processingrequired by the interaction and the remote session browsingconfiguration as further depicted in illustrative FIG. 7A. For example,some local interface components may be managed locally by browser coderunning on the client computing device, while other local interfacecomponents may have one or more locally managed aspects (e.g., buttonclick feedback, scroll bar redraw, etc), and one or more remote managedaspects treated as remote user interactions (e.g., page refresh,requesting a page at an address in an address bar, etc.)

At block 1104, the client computing device 102 obtains a userinteraction from the user. This user interaction may be an interactionwith local interface components as described in FIG. 7A and above, ormay be an interaction with any interactive elements of the contentdisplayed in the content display area of the browser, such as formfields, buttons, animations, etc. User interaction with these localinterface components or interactive elements of displayed content mayrequire local and/or remote processing depending on the nature of thecomponent or element and the processing split specified by the remotesession browsing configuration as described in FIG. 7A and above. Atblock 1106, the client computing device 102 determines the interactionprocessing requirements for the obtained user interaction. At decisionblock 1108, if the user interaction has local aspects (e.g., buttonclick feedback, a change to a local browser state, a content elementbeing processed at the client computing device, etc.) the routine 1102moves to block 1110 to process the local aspect or aspects of the userinteraction at the client computing device 102 and subsequently updatethe local interface components at block 1112. Illustratively, and asdiscussed above, aspects of the interaction and updating interfacecomponents and elements locally allows a browser to provide responsiveuser interfaces and content. Subsequent to processing local aspect(s) ofthe user interaction, or if the user interaction has no local elements(e.g., a user interaction with a content element displayed in thecontent display area when using a remote session browsing configurationprocessing entirely on the server side and utilizing an RDP remotesession communication protocol) the routine 1102 moves to decision block1114. If the user interaction has remote aspects that requireprocessing, the routine 1102 moves to block 1116 and provides remoteuser interaction data to the network computing provider 107.Illustratively, in the case of a heavily server side remote sessionbrowsing configuration utilizing an RDP remote session communicationprotocol, the remote user interaction data may include input data suchas a cursor position or keyboard input encapsulated in one or more RDPprotocol data units. In some embodiments of remote session browsingconfigurations utilizing RDP or other remote session communicationprotocols, particular aspects of remote user interaction data such ascursor positions may be provided to the network computing provider 107on a continuous basis, while in other embodiments of remote sessionbrowse configurations remote user interaction data may only be providedto the network computing provider 107 when associated with a userinteraction that requires remote processing.

At block 1118, the client computing device 102 obtains an updatedprocessing result from the network computing provider 107, the networkcomputing provider 107 having processed the remote user interaction datato generate an updated representation of the content. At block 1120, theclient computing device 102 performs any additional processing requiredon the updated processing result (based on the remote session browsingconfiguration) and at block 1122 displays the updated processing resultin the content display area of the browser. At block 1124 the processuser interaction routine 1102 ends. Illustratively, the routine may beexecuted again any number of times in response to further userinteractions with the browser and displayed content.

FIGS. 12 and 13 illustrate routines 1200, 1300 implemented by a networkcomputing provider 107 for receiving and processing narrations ofnetwork resources, and for providing those narrations to end users.Network resources, such as web pages, often contain text, images,videos, animations, applets, input fields, and the like. Navigating andinteracting with such web pages can be difficult for users with visualand other impairments. For example, some users of client computingdevices 102 may not be able to read the text on a web page due to pooreyesight, inability to read, limited display capabilities, a need tofocus visual attention elsewhere, etc. Spoken narration can be providedto such users, and can include not only a verbatim reading of anytextual components of the web page, but also a description of theimages, animations, and other non-textual visual elements. Additionally,narrated previews can be provided to the user, describing what willhappen if a user activates a link or other input field, etc. In someembodiments, a narrator can paraphrase the text in a web site or provideanalysis and opinion about elements of the web page to the user inaddition to, or instead of, a strictly factual recitation of the visualelements of the web page. In some embodiments, the spoken narration canbe generated by text-to-speech software. In some embodiments, thenarration is not a spoken description of visual elements, but rather awritten or otherwise visual description. Such a visual narration may beprovided to users with hearing impairments, to users who requiredadditional help or instruction on how to interact with elements on apage, to users who wish to receive the commentary and analysis describedabove without requiring use of speakers or headphones, etc. In someembodiments, a visual narration can be coupled to a spoken narration toprovide a rich, multimedia narrated experience to a user.

Narrations can be provided by users of a client computing device 102,utilizing a browser interface as illustrated and described above withrespect to FIG. 7A. In some embodiments, narrations can be providedusing alternative techniques, such as stand-alone narration software, aremote desktop connection into a network computing provider 107, etc.The discussion that follows with respect to FIG. 12, describing spokennarrations with visual elements recorded on a client computing device102 and transmitted upon completion to a network computing provider 107,is illustrative only, and is not intended to be limiting.

FIG. 12 illustrates a routine 1200 implemented by a network computingprovider 107 for receiving narrations from client computing devices 102,and the storage of the narrations so that the narrations may be providedto users of client computing devices 102 at a later time. The routine1200 begins at block 1202 with the initialization of a narrationcreation session. A narration can be created by a narrator, which may bea single person, a team of narration creation specialists, text-tospeech software, some combination thereof, or any other appropriatenarration creator. In the example described herein with respect to FIG.12, the narrator can be a single user of a client computing device 102.A narrator may decide to provide a narration of a network resource, suchas a web page, for one of any number of reasons. For example, a narratormay provide narrations for pay or other compensation, on a volunteerbasis, etc. The narrator may utilize a browser interface 700 asdescribed above and illustrated in FIG. 7A. The client computing device102 may connect to a network computing provider 107, and in response thenetwork computing provider 107 may instantiate a network browserapplication which communicates with the browser application executing onthe client computing device 102, as describe in detail herein. Theinitialization of a narration creation session may involve fewer oradditional procedures not detailed here. In response to the successfulinitialization of a narration creation session, the routine 1200 canproceed to block 1204.

At block 1204, the narrator can select a network resource, such as a webpage, for which to create a narration. For example, if a narrator wishesto create a narration for a news web site, the narrator may go to thehome page of the news web site and transmit a communication to thenetwork computing provider 107 that the narrator has selected the homepage of the news web site. This communication can be transmitted as partof, or in addition to, the other communications between the networkbrowser of the network computing provider 107 and the browserapplication on the client computing device 102, described in detailabove. For example, a browser application on the client computing device102 transmits requests for network resources to the network computingprovider 107, which then retrieves, processes, and provides the networkresources to the client computing device 102, while in some casesretaining some or all of the processing of the network resource at thenetwork computing provider 107. In this example, a narrator may requestthe home page of the news web site, and the network computing provider107 may retrieve, process, and transmit the home page to the clientcomputing device 102. The client computing device 102 may then transmitadditional communications to the network computing provider 107detailing user interactions with the home page, such as the activationof the create narration button 704 illustrated in FIG. 7A. The networkcomputing provider 107 may then be notified that the user is creating anarration for the currently displayed web page. In response to receivingthe notification, the routine 1200 can proceed to block 1206.

At block 1206 of FIG. 12, the narrator may record and transmit to thenetwork computing provider 107 a spoken overview of the currentlydisplayed web page. Returning to the example above, the narrator maydescribe the overall visual layout of the page and read any top-levelheadlines. The page overview narration can be created as a separaterecording, or can be part of a larger running recording of the narrationof the entire page. The recording can be streamed to the networkcomputing provider 1206 for storage as it is being recorded. In someembodiments, the recording can be made and saved as a file or buffer onthe client computing device 102, which is later transmitted to thenetwork computing provider 107. In some embodiments and in some specificcases, a page overview may be neither required nor appropriate,depending upon the implementation and the specific network resourcebeing narrated. In response to finishing the page overview, or if noneis provided, the routine 1200 can proceed to block 1208.

At block 1208, the narrator can select a specific portion of the webpage to narrate. This can be useful, for example, when a page hasmultiple distinct and potentially unrelated portions. The web pageillustrated in FIG. 7A, for example, includes a dynamic top storiesportion 720 and a best seller list portion 708, in addition to links,headlines, paragraphs of text, etc. Each portion can be given a separatenarration, allowing a listening user to select and listen to onlynarrations of portions that the listening user is interested in.Separating the narration of the web site into portions can also help toensure that if one portion of the web site is changed, only thecorresponding portion narration will need to be removed or replaced,rather than all narrations of the web page. In response to a portion ofthe web page being selected, execution of the routine 1200 can proceedto block 1210.

At block 1210, the narrator can provide an overview of the portion, in amanner similar to the page overview discussed above and shown at block1206. The recording can be streamed to the network computing provider1206 for storage as it is being recorded. In some embodiments, therecording can be made and saved as a file or buffer on the clientcomputing device 102, which is later transmitted to the networkcomputing provider 107. Additionally, the portion overview may not beappropriate or required, depending on the implementation and the networkresource. In response to the completion of the portion overview, or ifnone is provided, the routine 1200 can proceed to block 1212.

At block 1212 the narrator can provide a detailed narration of theselected portion. For example, in the news web site example, thenarrator may have selected the best seller list portion 708 illustratedin FIG. 7A. The narrator can read the contents of the list, and can alsodescribe what will happen if the user were to click on an item in thelist. For example, the best seller list portion 708 may contain images710 which are clickable, and which take the user to a more detaileddiscussion of the list item, or to another page where the user canpurchase the list item, etc. In some embodiments, the narrator canactivate the link and provide the user with a narrated preview of thelinked page. In response to completing the narration of a portion, theroutine 1200 can proceed to decision block 1214.

At decision block 1214 of FIG. 12, the narrator may choose to narrateadditional portions, if any exist, of the active network resource.Returning to the news web site example, the narrator may wish to narratethe top news stories portion 720 illustrated in FIG. 7A. In such a case,the routine 1200 could return to block 1208, where the narrator couldselect the top news stories portion 720 for narration. If the narratordoes not wish to provide narration of additional portions, or if thereare no more portions to narrate, the routine 1200 can proceed todecision block 1216.

At decision block 1216 of FIG. 12, the narrator may chose to narrateadditional web pages. For example, in the news web site example, thenarrator may wish to narrate detail pages dedicated to a particular newsstory. In such a case, the routine 1200 could return to block 1204,where the narrator could select the next web page to narrate. If thenarrator does not wish to provide narration of additional pages, or ifthere are no more pages associated with the web site, the routine 1200can proceed to block 1218, where execution terminates.

FIG. 13 illustrates a routine 1300 implemented by a network computingprovider 107 for providing narrations to users of client computingdevices 102. The routine 1300 begins at block 1302 with the receipt of anarration request from a client computing device 102. For example, auser of a client computing device 102 may navigate to a networkresource, such as the news web site described above, and activate anarration playback button 712 or link 724, as illustrated in FIGS. 7Band 7C. In response to a page narration request, the routine 1300 canproceed to block 1304.

At block 1304, the network computing provider 107 can cause the pageoverview narration, if there is one, to play back on the clientcomputing device 102. The narration can be transmitted as a file to theclient computing device 102 for playback, can be streamed to the clientcompeting device 102, etc. As described above, the narration can includeboth audio and visual elements, and the narration can be played back onthe client computing device 102 without interfering with the user'sability to scroll, activate links, or otherwise interact with the pageas normal. In some embodiments, the user may be provided with an optionto download the narration rather than having the narration played backinteractively. For example, an audio or video file may be provided sothat the user can watch or listen to the narration offline.

At block 1306 the network computing provider 107 can determine whichchanges, if any, have occurred to the network resource since thenarration was recorded. Returning to the news web site example, thenetwork computing provider 107 can use one or more of the techniques1308 to determine which changes have occurred to the top stories portion720 of FIGS. 7A, 7B and 7C. As illustrated in FIG. 7A, the top storiesportion 720 may have contained one or more content portions when thenarration was created, and as illustrated in FIG. 7C, the top storiesportion 720 may contain one or more different content portions whennarration playback is requested. The network computing provider 107 canthe utilize techniques 1308 of FIG. 13, such as processing usernotifications, performing pixel analysis, comparing digital pagefingerprints, etc., or any combination thereof, to determine whichportions, if any, have changed since the narration was created. Thedetermination of changes can be made when the page narration playbackrequest is initially received at block 1302, during page overviewplayback at block 1304, in response to receiving a request for playbackof the narration of a specific section at decision block 1310, describedbelow, or at any other appropriate time.

In one example, the network computing provider 107 may receivenotifications from multiple users of client computing devices 102 whenthe users are playing back narrations. The notifications can inform thenetwork computing provider 107 that one or more portions of a networkresource have changed. The network computing provider 107 can performsome processing and analysis on the notifications, such as applyingmachine learning algorithms to the notifications and to the past andpresent pages, giving weight to notifications that are corroborated bysubsequent notifications, assigning staff members to inspect the page toconfirm that the notifications are accurate, etc. In another example,the network computing provider 107 can perform pixel sampling analysison the current version of the web page, sampling pixels and determiningwhat content is to be displayed on the screen at the pixel location byanalyzing the network browser's rendering of the web page, receivingpixel data from the client computing device 102, etc. The content at thepixel can be determined by consulting the HTML tag that governs thedisplay at the pixel location, by saving the actual value of the colordisplayed by the pixel, or some other technique. The network computingprovider 107 can then perform the same pixel sampling analysis to theversion of the web page as it existed when the narration was created.This can involve restoring a copy of the web page from the time thenarration was created, loading pixel profile data that was stored at thetime the narration was stored, etc. By comparing profile data from thecurrent web site to the pixel profile data from the web page as itexisted when the narration was created, the network computing provider107 can determine differences between the two, and the difference mayrepresent portions of the web page that have changed. In yet anotherexample, the network computing provider may create or observe a digitalweb page fingerprint of the page at the time the narration was created,and can compare the fingerprint to a digital web page fingerprint of thepage at the time playback of the narration is requested. The fingerprintcan be a hash of the page or each portion of the page, a pixel/contentmap similar to the pixel analysis described above, meta data about thepage, some combination thereof, etc.

At decision block 1310, the network computing provider 107 can receive aselection of a portion or specific element on the web page. If aselection is received, execution of the routine 1300 can proceed toblock 1312. If no selection is received, execution of the routine 1300can proceed to decision block 1316.

At block 1312, the network computing provider 107 can notify the user ofany changes to the portion which have occurred since the time thenarration was created. The notification can be an audio and/or visualnotification, and in some case can include information about what haschanged. For example, in the news web site illustrated in FIGS. 7A and7C, the user can be notified that the content in the top stories portion720 has been changed, and that the narration playback that follows maynot be accurate. In some embodiments, rather than notifying the userthat the portion has changed, the out of date portion of the narrationcan be withheld from playback, either with or without a notification tothe user. In some embodiments, the network computing provider 107 canmonitor changes to underlying network resources as a stand-alone serverprocess without requiring a request from a client computing device 102,and can solicit an updated narration for out of date portions beforethey are requested by a user. Newly created narration portions can thenbe incorporated into the narration for the web page.

If a narration exists for the selected portion, the routine 1300 canproceed to block 1314, where the network computing provider 107 causesplayback of the narration to the user of the client computing device102. The narration can be played back in a manner similar to the pageoverview playback detailed above with respect to block 1302. Asdescribed above, the user of the client computing device 102 may bepermitted to interact with the web page during narration playback, suchas clicking on links, etc.

At decision block 1316, the network computing provider 107 can receiveuser notifications. As described above with respect to the techniques ofblock 1308, the network computing provider 107 may analyze usernotifications transmitted to the network computing provider 107. A usernotification may correspond to a portion of the web page to which theplayed narration no longer applies, is erroneous, etc. For example, auser of a client computing device 102 may determine that a portion ofthe web page being narrated, such as the top stories portion 720illustrated in FIG. 7C, has changed since the narration was created, andthe narration no loner applies to the portion. The user may thentransmit a notification to the network computing provider 107. If a usernotification is received, the routine 1300 can proceed to block 1318.Otherwise, execution of the routine can proceed to block 1320.

At block 1318, the network computing provider 107 can process anotification received in decision block 1316. Processing can includecomparing the current version of the web page to an archived version ofthe page as it existed when the narration was originally created,dispatching a staff member to manually confirm any change in the page,etc. If a change is confirmed, the network computing provider 107 canalter the narration, as described above. The routine 1300 can thenproceed to block 1320, where execution terminates.

FIG. 14 illustrates a routine 1400 implemented by a network computingprovider 107 for updating a narration of a network resource in responseto changes in the content of the network resource. The routine 1400begins at block 1402 with the initialization of a narration editsession. The narration edit session may be initialized in response toone of any number of events. For example, a user may send a notificationthat a narration, or portion thereof, is no longer accurate, anautomated process may monitor the content of narrated pages to determinewhen a change has been made, etc. Additionally, narration informationmay be associated with expiration criteria, such as time-based criteriaor event-criteria, that would result in the determination that someportion of the narration is no longer valid. In response to thesuccessful initialization of a narration edit session, the routine 1400can proceed to block 1404.

At block 1404, the network computing provider 107 can retrieve thenarrated web page and determine whether a portion of the page haschanged since the narration was created or last updated. The networkcomputing provider 107 can use a number of techniques to determinewhether the page has changed, as described above with respect to FIG.13. For example, the network computing provider 107 can perform pixelanalysis, compare page fingerprints, etc. In response to determiningthat a portion of the page has changed, the routine 1400 can proceed toblock 1406.

At block 1406, the network computing provider 107 can request an updatednarration for the changed portion. In some embodiments, the networkcomputing provider 107 may generate a request to the same narrator thatcreated the original narration, or to any of a group of predeterminednarrators. Alternatively, the network computing provider 107 can place arequest in a queue, where the request can be fulfilled by the nextavailable narrator. In some embodiments, the network computing provider107 can utilize text-to-speech software to generate an updated auralnarration.

At block 1408, the network computing provider 107 can receive an updatednarration in response to the request generated in block 1406. Theroutine 1400 can then proceed to block 1410. In some embodiments, asubstantial period of time may pass between generation of a request foran updated narration and receipt of the updated narration, or it may becritical to update the narration to remove the inaccurate portion evenif an updated narration does not replace the inaccurate portion. In suchcases, the routine 1400 may proceed to block 1410 without receiving theupdated narration, and can return to block 1408 when the updatednarration has been received.

At block 1410, the network computing provider 107 can modify thenarration by adding the updated narration portion received in block1408. For example, the network computing provider 107 can replace theout-of-date portion with the updated narration portion. In someembodiments, an updated narration for the portion may not be available,such as when a request for an updated narration has been generated inblock 1406 but no narrator has created an updated narration. In suchcases, the network computing provider 107 can remove the outdatedportion of the narration without replacing, or by replacing it with anotification to the user that there is no narration available. Inresponse to modifying the narration, the routine 1400 can proceed todecision block 1412.

At decision block 1412 the network computing provider 107 can determinewhether there are additional portions of the web page for with thecorresponding narration is no longer accurate. If so, the routine 1400can return to block 1406 for each of the portions. If there are noadditional portions of the narration known to be inaccurate, the routine1400 can proceed to block 1414, where the updated narration can befinalized and execution of the routine 1400 terminates.

While illustrative embodiments have been disclosed and discussed, oneskilled in the relevant art will appreciate that additional oralternative embodiments may be implemented within the spirit and scopeof the present invention. For example, the techniques described hereinmay be utilized, without departing from the scope of the presentinvention, to allow remote processing management in any number of othersoftware applications and processes, including, but not limited to,image or video editing software, database software, office productivitysoftware, 3d design software, audio and sound processing applications,etc. Additionally, although many embodiments have been indicated asillustrative, one skilled in the relevant art will appreciate that theillustrative embodiments do not need to be combined or implementedtogether. As such, some illustrative embodiments do not need to beutilized or implemented in accordance with scope of variations to thepresent disclosure.

Conditional language, such as, among others, “can,” “could,” “might,” or“may,” unless specifically stated otherwise, or otherwise understoodwithin the context as used, is generally intended to convey that certainembodiments include, while other embodiments do not include, certainfeatures, elements and/or steps. Thus, such conditional language is notgenerally intended to imply that features, elements and/or steps are inany way required for one or more embodiments or that one or moreembodiments necessarily include logic for deciding, with or without userinput or prompting, whether these features, elements and/or steps areincluded or are to be performed in any particular embodiment.

The terms “comprising,” “including,” “having,” and the like aresynonymous and are used inclusively, in an open-ended fashion, and donot exclude additional elements, features, acts, operations, and soforth. Also, the term “or” is used in its inclusive sense (and not inits exclusive sense) so that when used, for example, to connect a listof elements, the term “or” means one, some, or all of the elements inthe list. Conjunctive language such as the phrase “at least one of X, Yand Z,” unless specifically stated otherwise, is otherwise understoodwith the context as used in general to convey that an item, term, etc.may be either X, Y or Z. Thus, such conjunctive language is notgenerally intended to imply that certain embodiments require at leastone of X, at least one of Y and at least one of Z to each be present

Any process descriptions, elements, or blocks in the flow diagramsdescribed herein and/or depicted in the attached FIGURES should beunderstood as potentially representing modules, segments, or portions ofcode which include one or more executable instructions for implementingspecific logical functions or steps in the process. Alternateimplementations are included within the scope of the embodimentsdescribed herein in which elements or functions may be deleted, executedout of order from that shown or discussed, including substantiallyconcurrently or in reverse order, depending on the functionalityinvolved, as would be understood by those skilled in the art. It willfurther be appreciated that the data and/or components described abovemay be stored on a computer-readable medium and loaded into memory ofthe computing device using a drive mechanism associated with a computerreadable storing the computer executable components such as a CD-ROM,DVD-ROM, or network interface further, the component and/or data can beincluded in a single device or distributed in any manner. Accordingly,general purpose computing devices may be configured to implement theprocesses, algorithms, and methodology of the present disclosure withthe processing and/or execution of the various data and/or componentsdescribed above.

It should be emphasized that many variations and modifications may bemade to the above-described embodiments, the elements of which are to beunderstood as being among other acceptable examples. All suchmodifications and variations are intended to be included herein withinthe scope of this disclosure and protected by the following claims.

What is claimed is:
 1. A system comprising: a network computing component executing on one or more physical network computing devices, wherein the one or more physical network computing devices are programmed by executable instructions to at least: receive a web page narration from a first client computing device, the web page narration comprising a plurality of audio clips, wherein individual audio clips of the plurality of audio clips comprise an aural description of a portion of a web page by a user of the first client computing device, and wherein the web page narration is generated separately from the web page; in response to receiving the web page narration including a first audio clip comprising an aural description of a specific portion of the web page, determine that the specific portion of the web page has changed; obtain a second audio clip comprising an updated aural description of the specific portion of the web page; replace, in the plurality of audio clips, the first audio clip with the second audio clip; and transmit at least a portion of the web page narration to a second client computing device, the portion of the web page narration comprising at least the second audio clip.
 2. The system of claim 1, wherein the aural description of the specific portion of the web page comprises at least one of a verbal transcription of text displayed in the specific portion, a verbal description of textual content displayed in the specific portion, or a verbal description of visual content displayed in the specific portion.
 3. The system of claim 1, wherein the one or more physical network computing devices are further programmed by the executable instructions to at least: determine that at least one audio clip of the plurality of audio clips comprises an invalid narration of a respective portion of the web page by at least: obtaining event-based criteria associated with the at least one audio clip; determining that at least one of the event-based criteria indicates a narration of the respective portion of the web page is inaccurate; and determining that the at least one audio clip comprises an invalid narration of the respective portion of the web page; and remove the at least one audio clip from the plurality of audio clips.
 4. The system of claim 3, wherein the at least one event-based criteria corresponds to a notification from a user indicating that the narration of the respective portion of the web page is inaccurate.
 5. A computer-implemented method comprising: under the control of a network computing component executing on one or more physical computing components of a network computing provider, the physical computing components configured to execute specific instructions, receiving a network resource narration from a first client computing device, the network resource narration comprising a first aural presentation of a portion of a network resource, wherein the network resource narration is generated separately from the network resource; in response to receiving the network resource narration comprising the first aural presentation of the portion, determining that the portion of the network resource has changed; obtaining a second aural presentation of an updated version of the portion of the network resource; replacing the first aural presentation with the second aural presentation of the updated version of the portion of the network resource; and transmitting, to a second client computing device, at least a portion of the network resource narration comprising the second aural presentation.
 6. The computer-implemented method of claim 5, wherein the network resource comprises at least one of a web page, image, video, applet, or document.
 7. The computer-implemented method of claim 5, wherein the portion of the network resource narration comprises at least one of an aural description, an aural recitation, or an aural translation of a portion of the network resource.
 8. The computer-implemented method of claim 7, wherein at least one aural description of the portion of the network resource comprises a verbal description of an image or video displayed in the portion of the network resource.
 9. The computer-implemented method of claim 7, wherein at least one aural description of the portion of the network resource comprises a verbal description of a result of an action taken on an element displayed in the portion of the network resource.
 10. The computer-implemented method of claim 5 further comprising: obtaining time-based criteria regarding whether an aural presentation comprises a valid narration of a respective portion of the network resource; comparing a time-based characteristic of the aural presentation with at least one of the time-based criteria to determine whether the aural presentation comprises an invalid narration; and in response to determining that the aural presentation comprises an invalid narration, removing the aural presentation with the invalid narration from the network resource narration.
 11. The computer-implemented method of claim 10, further comprising determining a time between generating a request for an updated narration of the respective portion of the network resource and receiving an updated narration of the respective portion of the network resource.
 12. The computer-implemented method of claim 11, wherein comparing the time-based characteristic of the aural presentation with at least one time-based criteria comprises determining whether a time threshold has been exceeded by the time.
 13. A system comprising: a network computing component executing on one or more physical network computing devices, wherein the one or more physical network computing devices are programmed by executable instructions to at least: receive a narration from a first client computing device, the narration comprising a first audio clip describing a portion of the network resource, wherein the narration is generated separately from the network resource; in response to receiving the narration comprising the first audio clip, determine that the portion of the network resource has changed; obtain a second audio clip describing an updated version of the portion of the network resource; replace the first audio clip with the second audio clip describing the updated version of the portion of the network resource; and transmit, to a second client computing device, at least a portion of the narration comprising at least the second audio clip.
 14. The system of claim 13, wherein the network resource comprises at least one of a web page, image, video, applet, or document.
 15. The system of claim 13, wherein the network resource comprises a first web page, wherein the portion of the network resource corresponds to an aural description, the aural description indicating a representation of content on the first web page.
 16. The system of claim 15, wherein the first web page comprises a link to a second web page, wherein the aural description indicating the representation of content on the first web page corresponds to a description regarding an activation of the link to the second web page.
 17. The system of claim 16, wherein the aural description of the portion of the first web page comprises a sign language translation of at least a portion of the first web page, wherein the sign language translation describes a preview of the portion of the first web page indicating a redirection to a second web page, the second web page comprising a web page where a purchase of an item can occur.
 18. The system of claim 13, wherein the portion of the network resource comprises a verbal description of an image displayed in the portion of the network resource.
 19. The system of claim 18, wherein the image displayed in the portion of the network resource corresponds to a best seller list, and wherein the verbal description comprises a narrated preview of an activation of the best seller list.
 20. The system of claim 19, wherein the narrated preview of the activation of the best seller list is associated with a redirection of a user of the network resource to a second network resource, the second network resource comprising a portion for a transaction of an item on the best seller list. 